Universal role of correlation entropy in critical phenomena 
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In statistical physics, if we successively divide an equilibrium system into two parts, we will face 
a situation that, within a certain length £, the physics of a subsystem is no longer the same as 
the original system. Then the extensive properties of the thermal entropy S'(AB) = 5(A) + 5(B) 
is violated. This observation motivates us to introduce the concept of correlation entropy between 
two points, as measured by mutual information in the information theory, to study the critical 
phenomena. A rigorous relation is established to display some drastic features of the non-vanishing 
correlation entropy of the subsystem formed by any two distant particles with long-range correlation. 
This relation actually indicates the universal role of the correlation entropy in understanding critical 
phenomena. We also verify these analytical studies in terms of two well-studied models for both 
the thermal and quantum phase transitions: two-dimensional Ising model and one-dimensional 
transverse field Ising model. Therefore, the correlation entropy provides us with a new physical 
intuition in critical phenomena from the point of view of the information theory. 

PACS numbers: 05., 05.70.Jk, 75., 75.10.Hk 



I. INTRODUCTION 

Entropy is one of the most important concept in both 
statistical physics pj and information theory 0, 0, 13 
It measures how much uncertainty there is in a state of 
physical system. In statistical physics, the entropy de- 
fined by 5 = log 2 VL depends on the number of states £1 
in an equilibrium system; while in the information theory, 
the entropy 5 — — tr(plog 2 p) is associated with the prob- 
ability distribution in the eigenstate space of the density 
matrix p. Therefore, it is interesting to look into some 
fundamental issues from different point of view due to 
the common ground of two fields. 

In statistical physics, if we divide an equilibrium sys- 
tem into a large number of macroscopic parts, the total 
number of state in phase space is a product form from 
the number w, of state in each part, i.e. Q = Hi w «- 
This precondition leads to that the entropy is an exten- 
sive quantity in statistical physics, i.e. 5 = J2i which 
is one of basis of the second law of the thermodynamics. 
However, a realistic system includes all kinds of interac- 
tion, and the dynamics at one site is no longer indepen- 
dent of other sites nearby. The facts implies that if we 
successively divide a system into two parts, we will face 
a situation that, within a certain length £, the physics of 
a subsystem is not the same as the original system. This 
length actually defines a characteristic scale for the sta- 
tistical physics, and physicists usually call it correlation 
length in the studying of different kinds of correlation 
function. From the point view of the information the- 
ory, for two subsystems A and B within the length scale 
£, they are no longer independent with each other, and 



their entropy does not satisfy the extensive property, i.e. 
5(AB) ^ 5(A) + 5(B). 

On the other hand, correlation function plays a fun- 
damental role in physics. Almost all physical quantities, 
not only in condensed matter physics, but also in quan- 
tum field theory, are related to the correlation function 
either directly or indirectly. Thus it devotes to under- 
stand many phenomena in both classical and quantum 
mechanics. Physically, the correlation function denotes 
the amplitude of the dependence of physical variables 
between two points in space time. From the information 
theory, it also partially measures how much uncertainty 
of a physical quantity at one location if the quantity at 
another one is given. However, this uncertainty still de- 
pends on the quantity itself. For example, in quantum 
system, the diagonal correlation function usually differs 
from the off-diagonal correlation function. Therefore, in 
order to learn the dependence between two separated sys- 
tems, it is important to ask such a question: to what ex- 
tent that the equality 5(AB) = 5(A) + 5(B) is violated. 
This question introduces a concept in the information 
theory, i.e. mutual information, which is defined as 



5(A : B) = 5(A) + 5(B) - 5(AB) 



(1) 
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where S(i) = — tx{pi log 2 pi), i = A,B,AB is the entropy 
of the corresponding reduced density matrix. If p is clas- 
sical, it is the Shannon entropy j2|, otherwise it is the 
von Neumann entropy p| of the quantum information 
theory. Actually, all correlation functions (OaO-q) be- 
tween A and B can be calculated from the reduced den- 
sity matrix pas , i.e. (OaO b ) = ^(OaObPab)- The 
mutual information, which measures the common shared 
information, defines a more general operator-independent 
correlation between two subsystems. Taking into account 
the role of entropy in the statistical physics, we would like 
to call it correlation entropy hereafter. 

To have a concrete interpretation, it is useful return 
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to intuitive understanding of the entropy itself. In the 
information theory, the entropy is used to quantify the 
physical resource (in unit of classical bit due to log 2 in its 
expression) needed to store information. For example, in 
the exact diagonalization approach, if we want to diago- 
nalize a Hamiltonian of 10-site spin-1 chain and no sym- 
metry can be used to reduce the dimension of the Hilbcrt 
space, we need at least 5 = log 2 3 10 = 10 log 2 3 bits to 
store a basis. Therefore, the correlation entropy actu- 
ally measures the additional physical resource required if 
we store two subsystems respectively rather than store 
them together. As a simple example, let us consider a 
two-qubit system in a singlet state (| tl) — I 4T))/v / 2, 
we have 5(A) = 1, 5(B) = 1,5(AB) = 0, which leads 
to 5(A: B) = 2. Obviously, there is no information in 
a given singlet state. However, each spin in this state 
is completely uncertain. So we need two bits to store 
them respectively. On the other hand, the correlation 
entropy is simply the twice of the entanglement, as mea- 
sured by partial entropy, between two systems because 
of 5(A) = 5(B) for pure state. The reason that we inter- 
pret the correlation entropy in this way is that besides 
the quantum correlation the state also has classical cor- 
relation. From this point of view, the correlation entropy 
is just a measure of total correlation, including quantum 
and classical correlation, between two subsystems. They 
go halves with each other in correlation entropy for pure 
state. For a mixed state, the correlation entropy also 
measures the amount of the uncertainty of one system 
before we learn one from another. From the above inter- 
pretation for pure state, it is then not surprising that the 
correlation entropy fails to measure the entanglement . 

In the statistical physics, the critical phenomena is the 
central topic. To have a complete understanding on the 
critical behavior, various methods, such as renormaliza- 
tion group p], Monte-Carlo simulation |8j, and mean- 
field approach etc., have been developed and applied to 
many kinds of systems. In recent years, the study on the 
role of entanglement in the quantum critical behavior 
have established a bridge between quantum information 
theory and condensed matter physics, and shed new light 
on the quantum phase transitions due to its interesting 
behavior around the critical point |T(i HTl IT2I Il3l IT3. Il5| . 
However, the entanglement is fragile under the thermal 
fluctuation and can be suppressed to zero at finite tem- 
peratures. Then it is difficult to witness a generalized 
thermal phase transition in terms of quantum entangle- 
ment. 

In this paper, we are going to study the role of correla- 
tion entropy in both thermal and quantum phase transi- 
tions. Like the fundamental role of two point correlation 
function in the statistical physics, we are interested in 
the universal role of two-point correlation entropy in the 
present work. The paper is organized as follows. In Sec. 
ITT1 for the pedagogical purpose, we study a toy model and 
show that the thermal entropy is not an extensive pa- 
rameter in such a simple system. In Sec. IIIII we discuss 
the relation between the reduced density matrix, long- 



range correlation, and the correlation entropy. In Sec. 
II VI we study the properties of the correlation entropy 
in thermal phase transition, as illustrated by classical 
two-dimensional Ising model. In Sec. [V] we address the 
properties of the correlation entropy in a simple quantum 
phase transition of one-dimensional transverse field Ising 
model. In Sec. IVII some discussions and prospects are 
presented. Finally, a brief summary is given in Sec. IVIII 



II. TOY MODEL: HEISENBERG DIMER 

For the pedagogical purpose and making our motiva- 
tion more clear, we first have a look on a very simple 
model: a Heisenberg dimer. Its Hamiltonian reads 



H = (J\ • (7 2 

where Ui(u x , a v ,a z ) are Pauli matrices at site i, 

- 



1 

1 







1 

-1 



(2) 



(3) 



and the coupling between two sites is set to unit for sim- 
plicity. The Hamiltonian can be diagonalized easily. Its 
ground state is a spin singlet state 



1 



V2 



[I U>-Ut>], 



(4) 



with eigenvalue Eq = —3, while three degenerate excited 
states are 



1 



* 2 = I TT) 



44) + 1 44}] 
* 3 = 1 44) 



(5) 



with higher eigenvalue £1,2,3 = 1- Therefore, accord- 
ing to the statistical physics, the thermal entropy of the 
system vanishes at zero temperature. When the system 
is contacted with a thermal bath with temperature T, 
the thermal state of the system is described by a density 
matrix: 



p = C 



where 



/ e- 2 / T 




V 





cosh(2/T) -sinh(2/T) 

sinh(2/T) cosh(2/T) 








-2/T 



(6) 



C 



1 



3e -2/T + e 2/T- 



(7) 



Because of SU(2) symmetry of the Heisenberg dimer, the 
single-site entropy 5(i) of the system is always unity, and 
the entropy of the whole system is 



5(12) 



log 2 (3e- 2 / T + l) 31og 2 (3 + e 4 / T ) 



3e- 2 / T + 1 



3 + e 4 / T 



(8) 
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Then we can see that 5(12) ^ 5(1) + 5(2) both at zero 
temperature and finite temperatures. In high temper- 
ature limit, the asymptotic behavior of the correlation 
entropy is 5(1 : 2) cx 1/T. So only when T — > oo, 
5(1 : 2) — > 0, the extensive property of the entropy holds. 
The physics behind this fact is quite clear. It is the inter- 
action between two sites that establishes a kind of cor- 
relation and then breaks the extensive property of the 
entropy. 

For a large system, however, this correlation usually 
decays with the increasing of distance between two parts, 
and the entropy becomes an extensive quantity beyond 
a definite scale. Only around the critical point where 
the phase transition happens, the system behaves like a 
whole and can not be divided into two part, and then the 
correlation entropy has long range behaviors. 



III. REDUCED DENSITY MATRIX, 
LONG-RANGE ORDER, AND CORRELATION 
ENTROPY 

In many-body physics, the reduced density matrix of 
a one-body and two-body subsystem can be, in general, 
written as 



(a'\p l \a) = tr(a iar pal a ), 

(a'(3'\p i: j\af3) = tr (a ia > a p> pa^alj, (9) 

respectively. Here ai a ,a,jp are annihilation operators for 
states | a), |/3) localized at site i, j respectively, and satisfy 
commutation (anti-commutation) relation for bosonic 
(fermionic) states. The reduced density matrix is usu- 
ally normalized as 



tr(pi) = 1, tr(p, tj ) = 1, 



(10) 



so that one has a probability explanation for their diag- 
onal elements in the corresponding eigenstate space. 

In spin system, the reduced density matrix of a single 
spin at position i takes the form 



1 



Pi = -(i+^n< + KK+(<)< 



(ii) 



For two arbitrary spins at position i and j, the two-site 
reduced density matrix generally takes the form, 

= i + zE(w + W) 



4 4 

a 

a/3 



(12) 



Obviously, under some symmetry, the above reduced den- 
sity matrix can be simplified. For example, if the state of 
N spins is also an eigenstate of z component of total spins 
S z = $t — an d possesses the exchange symmetry, 



then Eq. I|12|) can be simplified as 



pij 



( u+ 

wi z 

z* w 2 

V u~ 



(13) 



in the basis of crfcxj: {| TT>, I U), I it), I ii)}- Here the 
matrix elements can be calculated from the correlation 
function, 



(1 + {°iOj)) 



Wl 



U> 2 = -(l-<<7?<7*)), 



(14) 



With the help of the Jordan-Schwinger mapping 0] , 



a j ~ a j-\ a il> 



a] = (a] T a iT - a^a^) 



(15) 



where a| a stands for the pseudo fermionic creation op- 
erator for single particle state \j,a) at the position j, 
the element in the reduced density matrix 112(1 can be 
reexpressed in the form of Eq. @. For example, 



{a+a j ) = -(a^al L a zl a n ). 



(16) 



Therefore, we can explore the property of long-range cor- 
relation in spin system through pseudo fermion systems. 

We first consider the long-range correlation in classical 
systems, e.g. Ising model, in which the reduced density 
matrix takes the diagonal form, i.e. 



(a'\pi\a) = 5 a ' a tr(a la 'pal a ), 
(a'0'\pij\a/3) = 8 a i a 5piptt{a ia 'ajpi pa^a^ 

Then, if there is no long-range correlation 

(af3\pij\a(3) = tx(aya\ a ai a aj^p), 

-> (alalia) (aj aj0)> 
for \i — j\ — > oo, the two-site entropy becomes 
S(ij) - S(i) + 5(i), 

where 

5(Z) = -^{a\ ai )\og 2 {a\ li a w ), I = i,j 



(17) 



(18) 



(19) 



(20) 



where the normalization conditions of the pi(j\ and p^ 
have been used. Obviously, we have S(i : j) — 0, which 
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means that if there is no long-range correlation, the cor- 
relation entropy vanishes at long distance. 

On the other hand, if there exists long-range correla- 
tion, for example 

Gia,j/3 = {n ia n jf j) - {n ia )(n jf j) = C, (21) 

for \i — j\ — > oo and a constant C, then 

S(i : j) > 0. (22) 

Now we study the correlation entropy in the quantum 
systems, in which the reduced density matrix usually is 
not diagonal. Then, if the system does not have long- 
range correlation, 

(a'(3'\ PlJ \a(3) = {a\ a a lal ){a) p a ]pi ), (23) 

for \i — j\ — * oo, the reduced density matrix can be writ- 
ten into a direct product form, i.e. 



Pij = Pi <8> Pj. 



(24) 



Then the reduced density matrices pi , P j can be diago- 
nalized in their own subspace. So in principle, we can 
have p t = J2 a Pa\ ( Pa)it( l fi a \, and pj = J2p_P/3\ l Pp)jj( l Pp\, 
where p a ,Pp are the probability distribution for pi and 
Pj respectively. As we have done for the classical system, 
we then have 



S(i:j) = S(p i ) + S(p j )-S(p ij ) = 0. 



(25) 



In order to study its relation to the long-range corre- 
lation, now we express the correlation entropy in term of 
the relative entropy 01 

S(i : j) = tr(pij log 2 p t] ) - tr(p. iJ log 2 p t <g> p s ) (26) 

between the whole system and direct product form of two 

subsystems where (pt ® pj) Q p, a >p' = (aL a «*')( a ]/3 a .j"/3')- 
For Hermition operators pij, the eigen-equation 
Pij\4>aj3) — qap\4>ap) gives a representation of the cor- 
relation entropy in the basis {|0 Q /3)}- Therefore, in the 
eigenstate space of \4> a p), we have 

S(i-j)= ^2q a p\og 2 q a p 

- ^{<t><xfi\pij l0g 2 (/9z ® pjMotf})- (27) 

Insert the identity Y^ a 8 \ ( Pct ( Pp){ ( Pp<Pa\ — 1, it becomes 

S(i ■ j) = ^2 q a p log 2 q a p - ^ P a > p> , a pq a p \og 2 {p a pp) 

aP afia' p' 

where 

Pa'/3',af3 = (4>af3\Pa'Pf3') (lfia> VP'l&ap) (28) 

and satisfies 

P a 'P',a/3 > 0, ^ P a 'P',a(3 = 1, ^ Pa'/3',aP = 1- (29) 
a'j3' a(3 



Moreover, P a ' p> , a p will become unit matrix if and only if 
(4>apW a yp) = 1- Then 

S(i : j) (30) 

= X] l0g 2 lap - ^2 P «'P'^P log 2 (Pa'P^') 

ap \ a'P' 

Taking into account the concavity property of log func- 
tion, i.e. 

^2 P a<P',apl0g 2 (p a >pp>) < l0g 2 ^2P a 'P',apPaPp 
a'p' \a'P' 

we can have 

qap log 2 Qap 

aP 



ap 



where 



Qap 



qap 



J2a'p' Pa'p',apPaPp ' 



(32) 



The above inequality becomes an equality if and only if 
Pa'P',ap is an unit matrix. Therefore, if 

{a! ' (3'\p i:j \al3) = (aL a *"')( a ]/3 a j/3') + Cj (33) 

for \i — j\ — ► oo, P is not diagonal, then we have the de- 
sired result 



S(i : j) > 0. 



(34) 



In the information theory, the inequality similar to the 
above result is called Klein inequality |l8| • Therefore the 
existence of the long-range correlation will lead to a posi- 
tive correlation entropy (|34|l . This observation is very im- 
portant in understanding critical phenomena. According 
to the theory of either thermal or quantum phase transi- 
tion, the presence of the long-range correlation is crucial. 
However, different phase transition depends on the differ- 
ent long-range correlation. For example, in the superfluid 
phase of 4 He, the off-diagonal-long-range order, as sug- 
gested by Yang [l^, is necessary; while in anther kind 
of condensate of exciton, it may require diagonal-long- 
range order [2(j. Then the above results show that the 
non-vanishing positive defined correlation is a universal 
and necessary condition for all critical phenomena pij . 



IV. THERMAL PHASE TRANSITION: 
TWO-DIMENSIONAL ISING MODEL 

The physics in the above toy model is quite limited. 
In order to verify our analytical result and see the signif- 
icance of the correlation entropy in the critical phenom- 
ena, let us first study its properties in a thermodynamical 
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system. One of typical examples is the two-dimensional 
Ising model, which is certainly the most thoroughly re- 
searched model in statistical physics H3| • 

In the absence of external field, the model Hamiltonian 
defined on a square lattice field reads 



H 



<ij> 



(35) 



where the sum is over all pairs of nearest-neighbor sites i 
and j, and the coupling is set to unit for simplicity. Since 
the Ising model is a classical model, the reduced density 
matrix of two arbitrary sites then takes the form 



Pa 



u+ 

wi 

w 2 

m" 



(36) 



in which the elements can be calculated from Eq. 1)14)1 . 
and single-site reduced density matrix 



Pi 











1 



(37) 



For simplicity, we only consider the correlation entropy 
along (1, 1) direction, because the long distance behavior 
of the correlation entropy should be independent of the 
direction. 

Accordin g to the exact solution of the two-dimensional 
Ising model [23| , the magnetization per site of the system 
is 



(of) = { [1 - sinh- 4 (2/T)] 



1/8 







T <T C 
T>T C 



(38) 



where the critical temperature T c is determined by 

2tanh(2/T) = 1, (39) 

then T c ~ 2.269185. The correlation function can be 
calculated as 



y 0,0" N,N/ 



a a_i • • • a_Ar + i 
a\ ao • • • a_AT +2 



where 



and 



ttJV-l GjV-2 



27r Jo 



«o 



(40) 



sinh 2 (2/T) 



,1/2 



sinli (2/T) - e 



w 



(41) 



(42) 



Therefore, we can calculate the correlation entropy di- 
rectly from the known results. We show the correlation 
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FIG. 1: (color online) The correlation entropy as a function 
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FIG. 2: (color online) The correlation entropy as a function of 
the distance r (in unit of y/2 lattice constant) at the critical 
point. 



entropy S(i : j) as a function of temperature T and dis- 
tance between two site r = i — j in Fig. ^ 

The result is impressive. It is well known that the two- 
dimensional Ising model has two different phases sepa- 
rated by T c . Below T c , the system has macroscopic mag- 
netization, i.e., spontaneously magnetized, and its mean 
magnetization is determined by Eq. (|38|l . While above 
T c , the thermal fluctuation destroy this order and the sys- 
tem becomes paramagnetic. Therefore, it is not difficult 
to understand that the correlation entropy between two 
sites decay quickly as the distance increases. This fact 
implies that the extensive property of the entropy holds 
beyond a finite correlation length. So the physics in a 
small system can be used to described that for a large 
system. It is also the reason why in the Monte Carlo 
approach, a simulation on a small system at low tern- 
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FIG. 3: (color online) The critical behavior of the correlation 
entropy. LEFT: dS(0, : N, N) /dT below T c , and the inset is 
to explore its critical exponent. RIGHT: dS(0,0 : N,N)/dT 
above T c . 



perature and higher temperature agree with the analytic 
result in thermodynamic limit excellently. However, in 
the critical region, as we can see from Fig. ^ the corre- 
lation entropy decays in a power-law way. This fact not 
only tells us a strong dependence between arbitrary two 
sites in the system, but also manifests the integrality of 
the whole system. It is also the reason of the difficulty of 
the Monte-Carlo simulation around the critical region. 

Moreover, since the correlation entropy comprises all 
kinds of two-point correlation function in its expression, 
it can tell us more details about the critical phenomena. 
At the critical point, S(i) — 1 because of (erf) = 0, and 
the correlation function behaviors like 



S 



N 



'Q,0 U N,N/ 



A/N 



1/4 



(43) 



where A ~ 0.645. Then the two-site entropy can be 
simplified as 



S(ij) = 2-i[(l+5jv)log 2 (l + ^) 
+(l-S N )log 2 (l-S N )], 



(44) 



in the large N limit, and the correlation entropy behav- 
iors like 



5(0,0 : TV, N) 



A 2 



(45) 



2N 1 / 2 In 2' 

as has been shown in Fig. [3 On the other hand, around 
the critical point, the correlation entropy can be written 
as 



1 



Then 



dS(i:j) 
dT 



(46) 



dT 



M°t) 
dT 



(47) 



Therefore, in the critical region below T c , the dominant 
term in dS(i,j)/dT is 2{afaf}{(T?)d{a i }/dT, which leads 
to that dS(i,])/dT diverges as T — ► T c , and scales like 



ag(i;j ) 
dT 



oc 



IT - T r 



-3/4 



(48) 



as we can see from the left picture in Fig. [3J Then the 
critical exponents of dS(i, j)/dT below T c is 3/4, which is 
consistent with the critical exponent 1/8 of (a{). While in 
the critical region above T c , (a?) vanishes and the domi- 
nating term in S(i : j) becomes the correlation function. 
Then dS(i,j)/dT scales like 



dT 



cx In I T — T r 



(49) 



which is the same as the specific heat C v . Therefore, the 
critical exponent now becomes (See the right picture in 
Fig- 121)- Moreover, we also note that the slope of lines 
in the right inset of Fig. [21 is not the same. This is due 
to the fact that the exponent of the correlation function 
v introduce the distance dependence in the dS(i : j)/dT 
above T c . 



V. QUANTUM PHASE TRANSITION: 
ONE-DIMENSIONAL TRANSVERSE FIELD 
ISING MODEL 

We now study the correlation entropy in one- 
dimensional transverse field Ising model whose Hamil- 
tonian reads 



Ising 



N 

£ 

3=1 



Cl = (JN+1 



(50) 



where A is an Ising coupling in unit of the transverse field. 
The Hamiltonian changes the number of down spins by 
two, the total space of system then can be divided by 
the parity of the number of down spins. That is the 
Hamiltonian and the parity operator P = FJ . u z - can be 
simultaneously diagonalized and the eigenvalues of P is 
±1. We confine our interesting to the correlation entropy 
between two spins at position i and j in the chain. There- 
fore we need to consider both single-site reduced density 
matrix pi obtained from the ground-state wave function 
by tracing out all spins except the one at site i, and the 
two-site reduced density matrix obtained by tracing 
out all spins except those at site i and j. Then if there 
is no symmetry broken, such as in a finite-size system, 
according to the parity conservation, pi has a diagonal 
form Eq. (|37|l . and the reduced density matrix of two 
spins on a pair of lattice sites i and j can be put into the 
following block-diagonal form 



Pij 



( u + z- 

!Dl Z+ 







w 2 



(51) 



z~ 




FIG. 4: (color online) The correlation entropy as a function 
of A and the distance r (in unit of lattice constant) at T = 
for a system with N = 5000. 



in the basis | |T) A TJ-); I IT), I II) • The elements in the 
density matrix p t j can be calculated from the correlation 
function. 

u ± = i(l±2( ( rf) + (at**)), 



(52) 



Otherwise, if the symmetry is broken at the ground state 
of the ordered phase in the thermodynamic limit, i.e. 
(a x ) 0, then the single-site reduced density matrix 
becomes 



1 

Pi= 2 



1 + « 

(a?) 



1 - (erf 



(53) 



and the two-site reduced density matrix return to the 
original form 112f) since no symmetry can be used to sim- 
ply it. Therefore, the correlation entropy between two 
sites i and j becomes 



S(i : j) = 2tr pi log 2 pi - trpy- log 2 pij. 



(54) 



Taking into account the translation invariance, the cor- 
relation entropy is simply a function of the distance be- 
tween two sites. 

The transverse field Ising model can be solved exactly 
in terms of Jordan- Wigner transformation. The mean 
magnetization is given by |24| 



1 



\ " 



(1 — Acos0) tanh^/T] 



where lo^ is the dispersion relation, 



(55) 
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FIG. 5: The scaling behavior the correlation entropy between 




FIG. 6: The scaling behavior the correlation entropy between 
two sites at the longest distance. 



where q is integer (half-odd integer) for parity P = 
— 1(+1). The two-point correlation functions are calcu- 
lated as m 



o n) 



a-i 
a 



a-2 
a_i 



dN-2 0,N-3 



a-N 
a—N+i 

a-i 



(57) 



U N' 



a i 

a 2 



ai 



in ijv-i 



• • a-N+2 
■ ■ a—N+3 

ai 



(58) 



^0 = y 1 + A 2 - 2A cos(</> g ), 

^ q = 2nq/N, (56) 



(crgojv) = 4(<r z ) 2 - a N a- N 



(59) 
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where 
a N 



-y 



cos(cf>N) (A cos (j> — 1) tanh^/T] 
A ^ sm((j)N) sm((j>) tanh^/T] 



N 



We show the correlation entropy S(i : j) in the ground 
state as a function of coupling A and distance between 
two site r = i — j in Fig. 0] The result is also impressive. 
As is well known [jj, the ground state of the transverse 
field Ising model consists of two different phases, whose 
corresponding physical picture can be understood from 
both weak and strong coupling limit. If A — > 0, all spins 
are polarized along z direction, the ground state then is 
a paramagnet and in the absence of long-range correla- 
tion, while in the limit A > 1, the strong Ising coupling 
introduce magnetic long-range correlation in the order 
parameter a x to the ground state. The competition be- 
tween these two different order leads to a quantum phase 
transition at the critical point A c = 1. From Fig. 0] 
we can see that the correlation entropy tends to zero 
quickly as the distance between two sites increases in the 
paramagnetic phase. This phenomena can be well under- 
stood from the fact that the ground state in this phase 
is non-degenerate and almost fully polarized, therefore 
the knowledge of the state at one site i does not effect 
the state of another site j far away, which leads to zero 
information in common between two sites. However, this 
scene is not true in another phase. When A > 1, the 
ground state is twofold degenerate and possess long-range 
correlation. Before the measurement, the uncertainty of 
the state at an arbitrary site is very large. However, if 
we learn it from one site, the state at another site, even 
far away, is almost determined. Which leads to a finite 
correlation entropy between two sites even if they are 
separated far away from each other. 

Obviously, the behavior of correlation entropy in the 
transverse field Ising model is quite different from the 
quantum entanglement. In the previous works |lOl ITl) 
on the pairwise entanglement in the ground state of this 
model, it has been shown that the concurrence vanishes 
unless the two sites are at most next-nearest neighbors. 
In the paramagnetic phase, the correlation entropy share 
similar properties in common with the concurrence. In 
the ordered phase, however, the correlation entropy does 
not vanish even the distance between two sites becomes 
very large, such as 50 lattice constant. Moreover, the 
correlation entropy also shows interesting scaling behav- 
ior, just as that of the concurrence, around the critical 
point, as is shown in Fig. [3] Moreover, we find that at 
the critical point the first derivative of the correlation 
entropy between two neighboring sites scales like 



dS (0,1) 



dX 



const x IniV. 



(61) 
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FIG. 7: (color online) The correlation entropy as a function of 
A and the distance r (in unit of lattice constant) at T = 0.2. 
Obviously, at low temperature, the correlation entropy at long 
distance is destroyed in the quantum critical region around 
A = l. 



However, for those sites are separated far away, the 
correlation entropy shows quite different scaling behav- 
ior. For examples, in Fig. we show the scaling behavior 
the correlation entropy between two sites at the longest 
distance in a ring. This first observation is that when 
-/V — ► oo, dS(0,N/2)/dX becomes divergent. Moreover, 
detailed analysis reveal that the maximum value of the 
first derivative of the correlation entropy between two 
farthest sites in a ring scales like 



dS(0, N/2) 
dX 



const x ln d N. 



(63) 



5(0, 1) ~ 5(0, 1)|a=Ac + const x O - x c) IniV. (62) 



which differs from In N for dS(Q, l)/dX. Obviously, these 
interesting scaling behavior enable us to learn the physics 
of real infinite system from the scaling analysis. 

On the other hand, there is no thermal phase transi- 
tion in one-dimensional quantum spin system according 
to the Mermin- Wagner theorem 26] . Thus let us study 
the properties of the correlation entropy away from zero 
temperature. The results are shown in Fig. [7] and for 
T = 0.2 and 0.5 respectively. We can see that at lower 
temperature T = 0.2, the correlation entropy is broken 
only around the critical region A ~ 1. As the temperature 
increases, the correlation entropy in larger A region is also 
destroyed. These observations tell us that the correla- 
tion entropy is a decreasing function of the temperature, 
as we can see from Fig. [5] Since the broken symme- 
try only exists in the ground state of an infinite system 
and the thermal fluctuation tends to destroy the correla- 
tion entropy, it is not possible to reestablish such a long- 
range correlation at finite temperatures. Therefore, no 
thermal phase transition happens in the one-dimensional 
transverse field Ising model. This observation, based on 
the numerical calculation, is consistent with the Mermin- 
Wagner theorem. 



9 




FIG. 8: (color online) The correlation entropy as a function 
of A and the distance r (in unit of lattice constant) at T = 
0.5T. At higher temperature, the correlation entropy at long 
distance is completely destroyed. 




FIG. 9: (color online) The correlation entropy as a function of 
temperature T and the distance r (in unit of lattice constant) 
at A = 2.0. We can see from the figure that the correlation 
entropy is protected by an energy gap at low temperature. 



VI. DISCUSSIONS AND PROSPECTS 

With analytical studies and numerical calculations, we 
have discovered the rigorous relation between the corre- 
lation entropy and the long-range correlation. It strongly 
indicates us the non-trivial role of the correlation entropy 
in the critical phenomena. This discovery motivates us 
to study both the thermal and quantum phase transi- 
tions from the point view of information theory, i.e. mu- 
tual information, whose non-vanishing behavior at long 
distance really witnesses the violation of the extensive 
properties of the entropy in the statistical physics, i.e. 
5(AB) = 5(A) + 5(B). In the two models we studied 
in this model, since the correlation length at the critical 
point diverges, the physics of the system has a strong 
dependence on the system size, i.e. the scaling behavior. 



On the other hand, it also implies that the entropy at the 
critical point is no longer a linear function of the volume 
of the system, i.e. 5 ^ sV. In one dimensional system, 
it has already been noted that entropy of the subsystem 
satisfies S(x) oc \n(x) [28| where x is the length of sub- 
system in the critical region of some spin systems. Then, 
from this point of view, the spatial degree of freedom of 
the system is suppressed around the critical point. This 
observation reminds us a well-known holographic prin- 
ciple on the entropy of the black hole which says that 
the entropy of the black hole is proportional to the sur- 
face. Though a rigorous prove is still not available, we are 
sure there there are something in common between the 
entropy in the critical phenomena and that in the black 
hole, and this relation deserve for further investigation. 

On the other hand, though we restrict ourselves to 
the two-point correlation entropy in the above studies, 
if the system processes block-block order, such as dimer 
order |2jj, it may be useful to investigate the proper- 
ties of block-block correlation entropy. A simple ex- 
ample is Majumdar- Ghosh model with the Hamiltonian 
H = J2i (Ji a i ' + J2&i ■ Ci+2); where J 2 is the cou- 
pling between two next-nearest neighbor sites. In this 
model, if J2 = 1/2, the ground state is a uniformly 
weighted superposition of the two nearest-neighbor va- 
lence bond state p7| : 

|^i} = [l,2][3,4]...[L-l,L] 

|^) = [i J l][2,3]..-[i-2,L-l] (64) 

where 

M = ^(iT>m-u>m-)- (65) 

Then the block-block correlation entropy can help us to 
understand such a dimer order. 

Moreover, from the definition of our correlation en- 
tropy, it is also useful to introduce a characteristic length 
for the statistical system, below which the extensive 
properties of the entropy is violated. Such a characteris- 
tic length has a non-trivial meaning, since the extensive 
property of the entropy in the statistical physics is only 
valid above this scale. A simple example is the molecule 
which is composed of some atoms. When we study the 
physics of molecule gas, we have to regard a molecule 
as a whole because of its internal order. Only when the 
temperature is high enough to break its order, the atom 
then plays the important role to the statistical properties 
of the system. 

Though we verify the non-trivial behavior of the corre- 
lation entropy in terms of spin systems, the rigorous rela- 
tion between the non-vanishing correlation entropy and 
long-rang correlation is valid for all many-body systems. 
Therefore, it is expected to provide more physical intu- 
ition into the critical phenomena, such as Bosc-Einstein 
condensation and superconductivity from the point view 
of the correlation entropy. Take the former as a simple 
example, the reduced density matrix between two sites in 
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the space-time can also be expressed in terms of bosons 
operators &x P |0) = cxp(— zpx) in space representation. 
At high temperatures, (p|p X x'|p') vanishes as x — x' in- 
creases. Only when the condensation happens, (0|p xx /|0) 
leads to a non- vanishing correlation entropy, just as what 
we have shown for the correlation entropy in quantum 
spin system. 

VII. SUMMARY AND ACKNOWLEDGEMENT 

In summary, the correlation entropy plays a univer- 
sal role in understanding critical phenomena. Its non- 
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cal behavior. 
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